Nonlinear susceptibilities and the measurement of a cooperative length 
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We derive the exact beyond-linear fluctuation dissipation relation, connecting the response of a 
generic observable to the appropriate correlation functions, for Markov systems. The relation, which 
takes a similar form for systems governed by a master equation or by a Langevin equation, can be 
derived to every order, in large generality with respect to the considered model, in equilibrium 
and out of equilibrium as well. On the basis of the fluctuation dissipation relation we propose a 
particular response function, namely the second order susceptibility of the two-particle correlation 
function, as an effective quantity to detect and quantify cooperative effects in glasses and disordered 
systems. We test this idea by numerical simulations of the Edwards- Anderson model in one and 
two dimensions. 



A central phenomenon in the statistical mechanics of 
interacting systems is the onset of long range order when 
approaching phase transitions, specifically second order 
ones such as the para-ferromagnetic or gas-liquid tran- 
sition. The coherence length £ expressing the range of 
correlations is disclosed by the knowledge of an appro- 
priate (two point) correlation function Cy, as is Cij = 
((TiCTj) — (<7j)(<7j) for the prototypical Ising model. The 
divergence of £ induces the scaling symmetry when the 
critical point is neared. In this framework, equilibrium 
linear response theory, relating Cij to its conjugate sus- 
ceptibility Xij (and more generally two time correlations 
Cij{h,h) = (o"i(ti)<7,-(ta)) - (<7i(ti))(<rj(te)) and suscep- 
tibilities Xij{t\,t2)) through the fluctuation-dissipation 
theorem (FDT) , has proved to be of the uppermost im- 
portance both theoretically and experimentally, allowing 
the alternative determination of correlations, and hence 
of £, through linear response functions. 

These concepts are not restricted only to equilibrium 
states, but inform non-equilibrium statistical mechanics 
as well. For example, in a broad class of aging systems 
the kinetics is characterized by the growth of a character- 
istic length L(t), determining a dynamical scaling sym- 
metry in close analogy to what happens in static phase- 
transitions. In view of these and related issues, increasing 
interest has been recently devoted to the generalization 
of linear response theory to out of equilibrium systems, a 
research subject originating from the recognition that the 
relation between Xij (ti , ti) and Cij (ti , t-i) may be used to 
define an effective temperature [l| and to bridge between 
equilibrium and non equilibrium properties 0] ■ Although 
a theorem of such a generality as the FDT cannot be de- 
rived off equilibrium, in the case of Markov processes 
a natural generalization in the form of a fluctuation- 
dissipation relation (FDR) between Xiji^ii ^2), Cij (tit ^2) 
and a correlator £)y (ix, £2) involving the generator of the 
stochastic process has been obtained This result 



could open the way, in principle, to measurements of 
Cij(t±,t2), and hence of L(t), from non equilibrium sus- 
ceptibilities, provided the properties of Dij are known. 

This whole approach cannot be straightforwardly ap- 
plied to the case of glasses, spin glasses and in several in- 
stances of disordered systems, because their unusual type 
of long range order is not captured by linear response 
functions or even by two point correlators: These quan- 
tities remain short-ranged, even when some long range 
order appears in the system. This is because ordered pat- 
terns are randomized by the quenched disorder so that, 
for instance, {o~i(Jj) (where the overbar denotes the av- 
erage over the disorder) vanishes even when (crjCTj) ^ 0. 
To circumvent this problem, one has to consider higher 
order (non linear) response functions or, equivalently, n- 
spin (n > 2) correlation functions C'"-*. Along this line, 
recently, a measure of cooperativity has been proposed [B[ 
relying on a four point correlation function as 



C[f(t,t w ) = ((Ti(t)(Ti(t w )crj(t)aj(t w )) 



- {<r l (t)cr l {t w )){cT 3 {t)a J {t w )). (1) 

The idea is that, while Cij is annihilated by the disorder 
average, the variance of Oi<jj survives, possibly providing 

informations on cooperativity. Cy has been proved to 
be effective in numerical simulations 0, 0] but its direct 
experimental investigation remains a challenge Q, as in 
general multi-point correlators. A natural way out of this 
deadlock is to measure responses to external perturba- 
tions, namely susceptibilities, as suggested by Bouchaud 
and Biroli [Io| and done experimentally in Q . In order to 
make sure what actually do the non-linear susceptibilities 
probe, however, it is crucial to establish their relationship 
with multi-point correlators. Some specific aspects of this 
issue have been considered recently [j| [l(| , limited to the 
case of systems governed by a Langevin equation, but a 
general formulation is presently lacking. 
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In this Paper, we present the exact derivation of the 
FDR beyond linear order for spin models evolving with 
Markovian dynamics. The systematic approach we use is 
quite general, allowing one to derive the response func- 
tion of an arbitrary observable to every order in the ex- 
ternal perturbation and to relate it to correlation func- 
tions of the unperturbed system, in equilibrium and out 
of equilibrium as well, for generic spin models (e.g. Ising, 
clock, Heisenberg models etc ...) in full generality with 
respect to the Hamiltonian and the evolution rules. We 
show that the FDR takes the same form for hard spins, 
whose kinetics is ruled by a master equation, and for 
soft spins systems governed by a Langevin equation, fur- 
ther supporting the generality of our result. This relation 
shows that, already in equilibrium, beyond linear order 
the susceptibility is related not only to multi-spin corre- 
lations C' n J but also to the D correlators, much like in 
linear theory out of equilibrium. This feature loosens the 
relation between response and multi-spin correlations, 
raising the question of which response function is best 
suited to detect cooperative effects. We argue that a 
particular susceptibility x^ c ' 2 \ basically the second order 
response of the correlation function C, is well fit to this 
task, and bears informations on the correlation length. 
We complement this idea by numerical simulations of 
disordered spin models, showing how the existence of a 
growing length can be detected using x^' 2 ^- 

Let us sketch the derivation of the FDR for hard 
spins [111 ] . Using the operator formalism, we consider for 
simplicity a system of Ising spins (but the result holds 
more generally) whose state is described by the vector 
<r) = |<jj) (i = 1,N) on a lattice. The stochastic 
evolution is characterized by the propagator 



P(t\t w ) = T exp 



dsW(s] 



(2) 



where W(t) is the time dependent generator of the 
process, which is assumed to obey detailed balance, 
and T is the time ordering operator. The expecta- 
tion (0(t)) of a generic observable O on the time 
dependent state \P(t)) is given by (— \0\P(t)), where 
( — | = X)<r( cr l i s the fiat vector. Using the propagation 
\P(t)) = P{t\t w )\P{t w )) of the states this can be written 
as ( — \OP{t\t w )\P(t w )). Switching on an external 
field h (perturbation) at time t w , changing P to P^, 
the expectation (0(t)) h = (-\OP h {t\t w )\P(t w )) 
can be expanded as {0(t))h — (O(t))o + 

£~ l(Vn!) . in It dh...ft dtn <.l (*, *1. *n) 

hj 1 (ti)...hj n (t n ), where 



R 



'ji—j- 



(-\o 



(t , 1 1 , . . . , t n ) — 

S n P h (t\t w ) 



Sh jl (t 1 )...Sh jri (t n ) 



h=0 



5hj 1 (ti)...8h jn (t n ) 



\P(tw)) 



(3) 



is the n-th order response function (t > t±, t n ). Let us 
workout R(°' 2 ^ as an illustration, the generalization to 
arbitrary n being straightforward . From @ one has 



dh h (ti) 
d 2 IU(ti 



S 2 P h (t\t w ) 
8h h (h)Sh j2 (t 2 ) 

dh J2 (t 2 ) ohij^h) 

where t\ > t 2 and Si 2 = 5j 1 ,j 2 S(ti — t 2 ). We choose a 
perturbation entering the Hamiltonian as — ^2ihi{t)<7* , 
where a z is the z Pauli matrix. Assuming single spin flip 
dynamics for simplicity, the generalization to multiple 
spin flips being straightforward, the derivative of the gen- 
erator is <9 n IU(ii)/<%"(ii) = (-PTWjdtiKZjX- Then 

?(£>,2) 



R%:>(t,t 1 ,h) = 



+ {3 2 (~\6P(t\t 2 )W ]2 \P(t 2 ))6 



12- 



(5) 



In order to obtain an expression involving only observable 
quantities (i.e. diagonal operators), we write W^a^ = 
\ [Wj 1 , a* x ] + 1{ Wj ± , cr? }, where [•] or { ■ } denote the com- 
mutator or the anticommutator. It can be easily shown 
that Bi{t) = {of , Wi(t)} is a diagonal operator with the 
property J^(of (t)) — (Bi(t)). Since the term with the 
commutator acts like a time derivative, the second order 
FDR is obtained 



*£? (Mi.**) - t( w^ m)an{tl)(Tn{t2)) 

- -^-(O^aj^Bj^h)) - ^-(0(t)B n (h)a 32 (t 2 )) 

+ (O^Bj^Bj^h))} + ^{0(t)a 3l (h)B n (t 2 )) 

x ^h,jAh-t 2 )- (6) 

Care must be used for t 2 — > t\ since the product of the 
commutators generates a singular term [llj. In a sta- 
tionary state, using Onsager reciprocity, the above result 
simplifies to 

R% 2 2 \t,h,t 2 ) = ^ I A^( ( t ) aii(tl y ia (k)) 

- - JL{0(t)B n (h)a j2 (t 2 ))\ + ^{0(t)a h (h)B h (t 2 )) 



x S hth 6(ti -t 2 ). 



(J) 



h=0 



Let us mention that for continuous variables (soft spins) 
governed by a Langevin equation dai{t)/dt — Bi(t) + 
i]i(t), by taking W as the Fokker-Planck generator, we 
obtain [12| the same FDR ((6|) (and hence (|7|)), without 
the last term containing the (^-functions. Since on the 
r.h.s. do only appear correlation functions of the un- 
perturbed system, Eq. ([7]) qualifies as the beyond-linear 



FDT, while Eq. ((6|) as its non-equilibrium generalization. 
This relation can be derived for the response of an arbi- 
trary observable to every order in the external pertur- 
bation, for hard and soft spins alike, without reference 
to a particular Hamiltonian or transition rates. Exactly 
like in the linear case the above FDR serves as the 
basis for the development of a no-field algorithm for the 
fast computation of the non linear response function, as 
it will be shown below. 

The peculiar feature of the non-linear FDR (|6|7j) is 
the ubiquitous (even in equilibrium) presence of the cor- 
relators D containing the operator B, which introduces 
a specific reference to the particular dynamical process 
through the generator. This hinders a direct relation 
between response and multi-spin correlation functions, 
hampering the procedure to associate £ to a susceptibil- 
ity, as in equilibrium linear theory. Despite this, we argue 
that a quantity related to the second order response of 
the composite operator O = = ofcr? 



where Rj^'^it, t\) is the linear response function of the 
spin <Ji 4], or, alternatively, the susceptibility 



h=0 



R 



(Mi)<' 1} (M2), (8) 



>,2) 



dh I dt 2 n\f \t,t 1 ,t 



(9) 



is well suited to detect cooperative effects (for disordered 
systems a disorder average is implicitly assumed), and 
may be used to determine £. In equilibrium systems this 
is readily seen, since a simple statistical mechanical cal- 
culation yields 



J H t — >oo J t — >oo 



2/-r2 

ij,eqi 

(10) 

namely the counterpart of the standard static equilibrium 
relation between correlations and susceptibilities. Tak- 
ing the k = component Xk=o, eq = 0-/ N ) E;,j xtjfq 00 
£ 4 - d - 2 »f ; therefore, one has direct access to the coher- 
ence length. Concerning the full two-time dependence of 
X i in a system characterized by dynamical scaling, 
by virtue of Eq. (JTUJ) one expects the same scaling form, 
with the same exponents, of C 2 , hence 



xi c =o ) (i,M = e 4 - d - 2 v( 



L(ty L(t) 



(11) 



On physical grounds, one may understand why cooper- 
ativity effects are revealed by x as follows: writing 



the susceptibility X^J (t, tu 
as Xij' X \t,t w ) 

2 



(xij(t,t w )}, where [4j Xij(t,t v 

(Ji(t)(7j(t) - (Ti(t)(Tj(t w ) - Oi{t) J dtiBjfa) , 
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FIG. 1: Data collapse of X (C in the inset) for several 
temperatures in the d = 1 EA model. The dashed lines are 
the expected power-laws in the non equilibrium regime. 



view of Eq. ([S]), x^' 2 ^ can be cast as — Xij^i^tw) = 
{x^Ht^x^ (t,t w )) (x%' 1 \t,t m ))(x% 1) (t,t w )). 
Namely, ^( c ' 2 ) is the correlation of the variable whose 
average yields x^ CT,1 \ much in the same way as C\j\t, t w ) 
is the correlation of the variable (Ji{t)ai(t w ) whose av- 
erage gives C. Since x^' 7 ' 1 ^ is the response function 
conjugated to C by the FDT, this suggests that x^' 2 ^ 
may be suitable (as will be further shown numerically 
below), to study cooperativity analogously, and for the 
same mechanism of C^ 4 \ Despite this, ^( c ^ 2 ) and 
can hardly be related. Actually, although appears 
in the first term on the r.h.s. of the FDR (|6l7p for 
TZ( C ' 2 \ the terms containing B spoil the relation between 
Tl^ and It can be shown, in fact, that in most 

cases these terms are comparable with the first. For 
example, the static relation (fT0|) depends crucially on 
the contributions of the terms containing B. 

An important advantage of ^( c ' 2 ) with respect to 
multi-spin correlations is its fitting to experimental 
measurements. In fact, switching on a field hi from 
t w onwards one has (ai(t)<jj(t))h = (<Ti(t)aj(t))h=a + 



Ej, m hihmll dh Jl dt 2 S 2 (a l (t)a J {t))/{Sh l (t 1 )8h m (t 2 )) + 
0(h 4 ). In disordered systems the first term on the r.h.s. 
vanishes and the only non-vanishing terms in the 
sum are those with I = i and m = j (or I = j 
and m = i). Hence, using the definitions 



-hihjx^ (t,t w ) + Q(h 4 ). 



-3M 3 

Therefore, the determination of \^ c ^ can be reduced to 
the measurement of a correlation function in an external 
field (for instance a uniform one). 

In order to check these ideas and to test the ef- 
ficiency of the method to measure the cooperative 
length we have computed numerically Xk=a 0) i n the 
Edwards- Anderson (EA) model with Hamiltonian H = 
Ey JijViVj ' m d < 2, simulated by means of standard 
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FIG. 2: Data collapse of x (c,2) for several T in the d — 2 
EA model with bimodal (open symbols)or Gaussian (filled 
symbols) bond distribution, with z(T) = 4/T. The dashed 
fine is the expected power-law in the non equilibrium regime. 



Montecarlo techniques, with Glauber transition rates, 
where £?, = cr, — taiih(f3J2j Jij a j)- The system is 
quenched from a disordered state at t = to different 
final temperatures T > 0. Xfe=o (^>0) * s computed us- 
ing Eq. ||SJ). It must be stressed that, due to the noisy 
nature of response functions, the advantage provided by 
the FDR ^ instead of applying an infinitesimal pertur- 
bation is numerically un-renounceable. In fact, besides 
providing an incomparably better signal/noise ratio, the 
h — > limit is built in the FDR. The analysis of the 

(c 2) 

data proceeds as follows: from the large t value Xk=o ' eq 
of X i knowing 77, £ can be extracted for each tem- 
perature. Regarding L(t), in the non-equilibrium regime 
L(t) -C £, X must be independent from £. Using (fTTj) 
this implies /(f/L(t),0) ~ [L{t) / £) A - d - 2r i . Hence the 
non-equilibrium behavior of L(t) can also be determined. 
With these results, one can control that data collapse is 
obtained by plotting ^~ 4+d+2n Xk=o(^ 0) vs L(t)/£ for 
all the temperatures considered (see Figs. Il|2| ). We have 
studied first the model in d — 1 with bimodal distribution 
of the coupling constants = ±1. This system can be 
considered as a laboratory since it can be mapped onto 
a ferromagnetic system where 77 = 1 and L(t) ~ /j 1 / 2 , 
with 2 = 2, are known analytically. Moreover, besides 
X^ c ' 2 \ one can also check the scaling of the usual corre- 
lation Ck=o(t,t) after the mapping and obtain another 
determination of L(t) and £. In doing so, we find that 
the two methods to extract L(t) and £ agree within the 
numerical uncertainty between them, and with the ana- 
lytical behaviors. The data collapse of x^' 2 -* and of C 
is shown in Fig. [TJ Here one clearly observes the non- 
equilibrium kinetics in the early regime, characterized by 
a power-law behavior of x with exponent 4 — d— 2r}, as 
expected, and the late equilibration with the convergence 
of Xfc=o(0»*) t° Xk=o eq- C behaves similarly. After this 



explicit verification, we turn to the d — 2 case, where 
the reference to C is not available. In this case, with 
both bimodal and Gaussian distributions of J^ , using 
77 = flij ] , we find a behavior of £ consistent with previ- 
ous results [H Ei]. Thc 

non-equilibrium behavior is com- 
patible with a power law L(t) ~ rj 1 / 2 ^) with a tempera- 
ture dependent exponent in agreement with z(T) ~ 4/T, 
as reported in [HI]. The data collapse of x^' 2 -* is shown in 
Fig. [2 Notice also the additional collapse of the curves 
with bimodal and Gaussian bond distribution, further 
suggesting that the two models may share the same uni- 
versality class at finite temperatures 13 1. 



In this Paper we have derived the exact beyond-linear 
FDR. The result, which can be straightforwardly ex- 
tended to every order, provides a rather general relation 
between response and correlation functions: It is satis- 
fied by systems described by a master equation or by a 
Langevin equation, without reference to specific aspects 
of the considered model. On the basis of the FDR we 
argued, providing numerical evidence, that the second 
order susceptibility ^ c ' 2 "> is well fitted to uncover coop- 
erative effects and to measure the coherence length in 
disordered and glassy systems. Importantly, this suscep- 
tibility has a simple operative definition, which might be 
fitted to experimental investigations. Finally, we men- 
tion that the relevance of the beyond-linear FDR is not 
restricted to the issue of cooperativity, but is related to a 
number of open questions among which the extension of 
the concept of effective temperatures beyond linear order. 
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